Systems and methods for augmented reality view

ABSTRACT

Systems and methods for presenting an augmented reality view are disclosed. Embodiments include a system with a database for personalizing an augmented reality view of a physical environment using at least one of a location of a physical environment or a location of a user. The system may further include a hardware device in communication with the database, the hardware device including a renderer configured to render the augmented reality view for display and a controller configured to determine a scope of the augmented reality view authenticating the augmented reality view. The hardware device may include a processor configured to receive the augmented reality view of the physical environment, and present, via a display, augmented reality content to the user while the user is present in the physical environment, based on the determined scope of the augmented reality view.

TECHNICAL FIELD

The present disclosure relates generally to a system for presenting anaugmented reality view to a user, and more particularly, to a system andmethod for presenting an augmented reality view by rendering theaugmented reality view based on a determined scope of objects in aphysical environment to personalize and enhance a user's experience.

BACKGROUND

Augmented reality is used to enhance natural environments or situationsand offer perceptually enriched experiences. With the help of advancedaugmented reality technologies, for example, adding computer vision andobject recognition, the information about the surrounding real world ofthe user becomes interactive. Information about the environment and itsobjects is typically overlaid on the real world information. Thisinformation can be virtual or real. Augmented reality also has a lot ofpotential in gathering and sharing tacit knowledge. Augmentationtechniques are typically performed in real time and in semantic contextwith environmental elements. Immersive perceptual information issometimes combined with supplemental information like scores over a livevideo feed of a sporting event. This combines the benefits of augmentedreality technology and heads up display technology (HUD).

Augmented reality technology allows virtual imagery to be mixed with areal world physical environment. In other words, computer generatedinformation may be superimposed on the user's field of view of the realworld physical environment to allow the user to make better decisionsand to provide an enhanced experience. For example, the augmentedreality view may include information related to physical environment,simulations of weather conditions, simulations of traffic flows,upcoming meetings and scheduled appointments, etc. presented to theuser, via a display. But, the augmented view may not be personalized foreach user profile.

Virtual reality tools have been developed to provide conceptvisualizations. For example, the advent of sophisticated virtual realitysoftware and other related tools has enabled a more engaging andinvolved experience for users. Virtual reality tools for video games andgaming experience enhancements have been extensively researched in therecent past. Virtual reality experience typically involves placing theuser in an audio-visual simulation of real-world like environment, butmost lack the ability to provide interactive and personalized views to auser.

In addition, currently, all businesses are limited by the amount ofavailable physical space. A common approach to this problem is rentingor buying real-estate such as a warehouse for temporary storage. Rentingor buying additional space is not only expensive, but inefficient andinconvenient as well.

While it is known to use virtual reality software tools and augmentedreality tools to enrich user experience, there is a need for a systemthat provides an enhanced and personalized experience by allowing theuser easy access to information and enabling the service provider withtools to enrich their customers' experience. In addition, there is aneed for a customizable experience for every user, based on theirpreferences and profiles.

The disclosed system and methods for presenting augmented realitycontent to a user, address one or more of the problems set forth aboveand/or other deficiencies in the prior art.

SUMMARY

One aspect of the present disclosure is directed to a system forpresenting an augmented reality view. The system may include a databasefor personalizing an augmented reality view of a physical environment,the database comprising at least one of a location of a physicalenvironment or a location of a user. The system may further include ahardware device in communication with the database, the hardware deviceincluding a renderer configured to render the augmented reality view fordisplay and a controller configured to determine a scope of theaugmented reality view based on authenticating the augmented realityview. The hardware device may include a processor configured to receivethe augmented reality view of the physical environment, the augmentedreality view representing one or more objects in the physicalenvironment, personalize the augmented reality view of the physicalenvironment based on the information in the database; and present, via adisplay, a personalized augmented reality view to the user while theuser is present in the physical environment, based on the determinedscope of the augmented reality view.

Another aspect of the present disclosure is directed to a method forpresenting an augmented reality view, the method including receiving,via a processor, the augmented reality view of a physical environment,the augmented reality view representing one or more objects in thephysical environment; determining, via a controller, a scope of theaugmented reality view based on authenticating the augmented realityview; personalizing the augmented reality view of the physicalenvironment using at least one of a location of the physical environmentor a location of a user; rendering, via a renderer, the augmentedreality view for display; and presenting, via a display, the augmentedreality view to the user while the user is present in the physicalenvironment, based on the determined scope of the augmented realityview.

Yet another aspect of the present disclosure is directed to a system forpresenting an augmented reality view. The system may include a databasefor personalizing an augmented reality view of a physical environment,the database comprising at least one of a location of a physicalenvironment or a location of a user; a renderer configured to render theaugmented reality view for display; a controller configured to determinea scope of the augmented reality view based on identificationverification of the user; and a processor configured to: receive theaugmented reality view of the physical environment, the augmentedreality view representing one or more objects in the physicalenvironment, personalize the augmented reality view of the physicalenvironment based on the information in the database, and present, via adisplay, augmented reality content to the user while the user is presentin the physical environment, based on the determined scope of theaugmented reality view.

In some embodiments, the processor may be further configured to executeat least one computer program configured to determine furtherpersonalization of the augmented reality view. In yet anotherembodiment, the processor may be further configured to determine one ormore portions of the augmented reality view that are not authenticated,and present the augmented reality content without the determined one ormore portions.

In some embodiments, the hardware device may further comprise a storagemedium configured to store the augmented reality view of the physicalenvironment. The hardware device may further comprise a media recordingunit configured to capture at least one of images or videos of theaugmented reality view of the physical environment. In some embodiments,the augmented reality content presented to the user is determined basedon at least one of the location or orientation of the hardware device.

In some embodiments, the database may be configured for updating basedon an updated layout of the physical environment. The layout of thephysical environment may comprise data describing one or more objects inrelation to at least one other object.

In some embodiments, the renderer is configured to add markers forcustomizing the augmented reality view based on at least one of thelocation of the user or a user preference. Consistent with someembodiments, rendering the augmented reality view may comprise renderingone or more of a static rendition, a dynamic rendition, or a contextualrendition.

In some embodiments, the augmented reality view may be based onauthenticating the view. Consistent with some embodiments,authenticating the view may comprise identification verification of theuser.

In some embodiments, the augmented reality view may represent at leastone boundary larger than at least one boundary of the associatedphysical environment. The larger boundary may be rendered by vectoringat least one boundary.

It is to be understood that both the foregoing summary and the followingdetailed description are exemplary and explanatory only and are notrestrictive of the invention, as claimed.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings, which are incorporated in and constitute apart of this specification, illustrate embodiments consistent with theinvention and, together with the description, serve to explain theprinciples of the invention. In the drawings:

FIG. 1 shows a block diagram of an exemplary system, in accordance withdisclosed embodiments.

FIGS. 2A-B illustrate an exemplary system for presenting an augmentedreality view to a user, in accordance with disclosed embodiments.

FIGS. 2C-D illustrate an exemplary system for presenting an augmentedreality view to a user, in accordance with disclosed embodiments.

FIG. 3 is a flow chart illustrating an exemplary method of presenting anaugmented reality view to the user, in accordance with disclosedembodiments.

FIG. 4 is a flow chart illustrating an exemplary method of presenting anaugmented reality view to the user, in accordance with disclosedembodiments.

FIG. 5 is a flow chart illustrating an exemplary method of presenting anaugmented reality view to the user, in accordance with disclosedembodiments.

DETAILED DESCRIPTION

The present disclosure is generally directed to systems and methods forpresenting an augmented reality view allowing an enhanced shoppingexperience for the user. The system includes a database forpersonalizing an augmented reality view of a physical environment usingat least one of a location of a physical environment or a location of auser. In some embodiments, the database may be configured for updatingbased on an updated layout of the physical environment. The system mayfurther include a hardware device in communication with the database,the hardware device including a renderer configured to render theaugmented reality view for display and a controller configured todetermine a scope of the augmented reality view by exchanging one ormore tokens between the hardware device and the database. In someembodiments, the hardware device may further comprise a storage mediumand a media recording unit configured to capture at least one of imagesor videos of the augmented reality view of the physical environment. Thehardware device may include a processor configured to receive andpresent augmented reality content to the user while the user is presentin the physical environment, based on the determined scope of theaugmented reality view. In some embodiments, the processor may befurther configured to execute at least one computer program configuredto determine further personalization of the augmented reality view. Inyet another embodiment, the processor may be configured to determine oneor more portions of the augmented reality view that are notauthenticated, and present the augmented reality content without thedetermined one or more portions.

Some aspects of the present disclosure may be incorporated in fieldsinvolving client-provider relationships, or more broadly, involving twoor more parties requiring interaction. In some aspects, a user may bepresented an augmented reality view of a trail while trekking orparticipating in other outdoor activities. It could be advantageous tosee the contours, pathways, angles, and other route challengesbeforehand to better prepare oneself. In other fields, such as retailshopping, a user may be presented with an augmented reality view ofstore layouts, store contents, personalized shopping offers, inventoriesetc. to provide an enhanced interactive experience to the user. Someaspects of the disclosure may also be useful for a retailer or abusiness owner for better inventory control and stocking by accessing anaugmented reality view of the warehouse. Some aspects of the presentdisclosure may be useful in the field of law enforcement and security.The law enforcement officers may benefit from an augmented reality viewof a building or a structure in case of a hostile situation, allowingthem to better prepare, plan and implement safe rescue operations.

Reference will now be made in detail to the disclosed embodiments,examples of which are illustrated in the accompanying drawings.

FIG. 1 is a block diagram of an exemplary system 100 for presenting anaugmented view to the user, in accordance with disclosed embodiments.System 100 may include databases 120 and 130, and a hardware device 140.In some embodiments, as shown in FIG. 1, each component of system 100may be connected to a network 110. However, in some embodiments,components of system 100 may be directly connected with each other.

In some embodiments, as shown in FIG. 1, database 120 and database 130may be separate entities from each other, separately connected tonetwork 110. In some embodiments, database 130 may be integrated intodatabase 120 such that database 120 is connected directly to network 110and database 130 is indirectly connected to network 110. Alternatively,database 120 and database 130 may be interchangeable.

In some embodiments, database 120 may be configured to be a primarydatabase and database 130 as a back-up database. In other embodiments,database 130 may be configured to be a primary database and database 120as a back-up database. A back-up database may be configured to performsimilar operations as a primary database or some additional supportingfunctions in accordance with disclosed embodiments.

In some embodiments, database 120 may include one or more computingdevices configured with appropriate software to perform operationsconsistent with personalizing an augmented reality view (such asaugmented reality view 245 in FIG. 2B) of a physical environment withina physical space (such as physical space 210 in FIG. 2A), using thelocation information of that physical space. Database 120 may beconfigured to contain information about the physical layout of aphysical space. The location information of a physical space mayinclude, for example, geographic information and/or physical locationinformation of a physical space.

In some embodiments, database 120 may include one or more computingdevices configured with appropriate software to perform operationsconsistent with personalizing an augmented reality view of a physicalenvironment using the location information of a user (e.g., user 220 inFIG. 2A) within a physical space. The location of a user may include,for example, geographic information and/or physical location informationof a user within a physical space.

In some embodiments, personalizing or customizing an augmented realityview for a user includes recognizing the user, authenticating the user,analyzing user profile, and presenting personalized shoppingrecommendations based on the user profile. In some embodiments,personalizing an augmented reality view may include providing marker(s)(e.g. marker 248 in FIG. 2B and FIG. 2D) to further customize theshopping experience for a user. Marker(s), as referred to herein, mayinclude an instruction or an indication delivered to a user whilepresent in the physical environment. In some embodiments, marker(s) maybe audio-visual instructions, or a sensory indication, or a combinationthereof, displayed in an augmented reality view to a user.

In some embodiments, marker(s) may be used by the retailer or businessowner to interact with user 220 in a more personalized way. For example,a marker may list personalized discounts, personalized offers, messages,personalized instructions, or directions to guide a user to a particularspace within the physical space to provide an enhanced and customizedshopping experience.

In some embodiments, database 120 may be configured for updating basedon updated layout of the physical environment within a physical space.Database 120 may be configured to be continuously updated based on theupdated layout of the physical environment. Hardware device 140 may beconfigured to detect a change in the layout of the physical environmentand communicate the change to database 120. In some embodiments,updating may be automatic or manual. Manually updating may be triggeredby user input. Automatic updating may be configured to execute atpre-determined times of the day, within pre-determined intervals,pre-determined events, or combinations thereof. In some embodiments,updating database 120 may also be triggered automatically based ondetermining a trigger event, for example, when the inventory of thestore is updated either by adding or removing more products or morevariety of products.

Database 120 may include, for example, Oracle™ databases, Sybase™databases, or other relational databases or non-relational databases,such as Hadoop™ sequence files, HBase™, or Cassandra™. Database 120 mayinclude computing components (e.g., database management system, databaseserver, etc.) configured to receive and process requests for data storedin memory devices of database 120 and to provide data from database 120.In some embodiments, database 120 may take the form of a server, ageneral purpose computer, a mainframe computer, or any combination ofthese components. Other implementations consistent with disclosedembodiments are possible as well.

While database 120 and back-up database 130 are shown separately in FIG.1, in some embodiments, database 120 and back-up database 130 may beincluded in or otherwise related to hardware device 140.

Hardware device 140 of system 100 may include, among other things, acontroller 150, a storage unit 160, a renderer 170, a processor 180, awireless card 190, and a media recording unit 195. Hardware device 140may also include other suitable components not illustrated in FIG. 1,consistent with its ability to communicate with database 120 and/orconnect to network 110. Additionally, those skilled in the art willrecognize that the illustrations of hardware device 140 are simplifiedto highlight aspects of the present invention and that hardware devicestypically include a variety of components not shown in FIG. 1.

In some embodiments, hardware device 140 may be, for example, asmartphone, tablet computer, smart eyewear, hand-held display,body-mounted display, shopping cart, head-mounted display, heads-updisplay, see through head mounted display, helmet-mounted display, orthe like. Other suitable hardware devices may be used. A user may walkaround a physical environment with hardware device 140 to obtain areal-time augmented reality view displayed on a display. Alternatively,the user may record the augmented reality view for later use.

Controller 150 may be a computing device configured to determine a scopeof an augmented reality view presented to a user. Determining a scope ofan augmented reality view may include, but not limited to, determiningwhether a product or merchandise should be presented in the augmentedreality view to a user. For instance, controller 150 may be configuredto determine whether a product or its details such as pricing,availability, images, etc. should be displayed or not based on the legalage of a user.

In some embodiments, determining the scope of an augmented reality viewmay include displaying products with a cautionary message. For instance,controller 150 may be configured to determine if a warning messageshould be displayed in an augmented reality view, such as when a user islooking at a pack of cigarettes.

Controller 150 may further be configured to determine the scope of anaugmented reality view presented to a user based on authenticating theaugmented reality view. In some embodiments, controller 150 may beconfigured to determine the content of augmented reality view based onauthentication. The content of augmented reality view, hereafterreferred to as the augmented reality content may include, for example,pricing information, product information, discount information, based onuser profiles and preferences.

Authenticating an augmented reality view of a user may includeidentification verification of the user. In some embodiments,authenticating an augmented reality view may include exchanging tokensbetween hardware device 140 and database 120. Security exchange tokens,such as software tokens, may be used as a means to uniquely identifyuser to create a personalized augmented reality view. A software tokenmay be a two-factor authentication security device that may be used toconfirm identification of the user.

In some embodiments, authenticating an augmented reality view may beperformed by using other well-known identification and verificationtechniques, for example, face recognition, audio-recognition, retinalscans, iris recognition, biometrics, finger-printing, security pinexchange, single-factor identification. Other suitable authenticationtechniques may be used.

Hardware device 140 may be equipped with additional components, forexample, a camera, a position sensor detection (PSD) device, a motionsensor detection (MSD) device, an infra-red camera, a finger-printrecognition device, an accelerometer, a global positioning system (GPS)device, a solid state compass, etc., to facilitate authenticating anaugmented reality view to a user. Hardware device 140 may include othersuitable components.

As shown in FIG. 1, hardware device 140 may include storage unit 160.Storage unit 160 may be configured to store information related to anaugmented reality view of the physical environment, and the physicalenvironment of a physical space. For example, storage unit 160 may beconfigured to store stills, images, and videos of an augmented realityview for a user to access later. In some embodiments, storage unit 160may store data related to products displayed in an augmented realityview or related products.

In some embodiments, for example, storage unit 160 may be configured tostore information related to a user. The user information may includeuser profile data, geographic and physical location of the user whileshopping, historical data, user shopping preferences, etc. Access tostorage unit 160 may require authentication of a user to protect dataand user privacy. The user may be prompted to store related informationas shared or private, for later use. Information stored as “shared” maybe accessed later by the user, or by the user's friends and/or familymembers to provide their input. Depending on the characteristic of theinformation selected by a user, the information may requireauthentication for granting access. In some embodiments, storage unit160 may be further configured to store information related to a virtualshopping cart or a list of items that user may potentially be interestedin buying. A user may access the stored information locally or remotely.In some embodiments, storage unit 160 may be further configured to storeinstructions used by processor 180, to perform functions related todisclosed embodiments. For example, storage unit 160 may be configuredwith one or more software instructions that may perform one or moreoperations when executed by processor 180.

In some embodiments, the information stored in storage unit 160 may beformatted in the form of a list, a chart, a table, a drawing, orcombinations thereof. The information may also be stored in coordinatespace to store each object's location information relative to at leastone other object as displayed in the physical environment of a physicalspace, at the time. The information stored in storage unit 160 may beaccessed by a user later to revisit the shopping experience.

As shown in FIG. 1, hardware device 140 may include renderer 170.Renderer 170 may be configured to render an augmented reality view fordisplay to a user. In some embodiments, renderer 170 may be a softwareprogram configured to receive information of the physical environmentand/or information of the physical location of a user within a physicalspace. Renderer 170 may include an app on a smartphone, or a smartphoneitself, head-mounted displays, heads-up display, smart eyewear, or acombination thereof. Other suitable renderers known to a personwell-versed in the technology may be used.

Renderer 170 may be configured to communicate with processor 180. Insome embodiments, renderer 170 may be configured to communicate withcontroller 150 configured to determine the scope of an augmented realityview. Renderer 170 may render augmentation based on the authenticationof a user. For example, if the authentication of the user isunsuccessful, renderer 170 may render a selective display that excludespersonalized offers. Alternatively, if the authentication is successful,renderer 170 may render advertising information offering special offersor deals on the product or alternative products, in the user's field ofview. In some embodiments, renderer 170 may be configured to renderaugmentation information in an appropriate format using visual and/oraudio presentation.

Rendering a personalized augmented reality view for a user may includerendering a static rendition, a dynamic rendition, or a contextualrendition, or any combination thereof. Static renditions may remainstationary in the personalized augmented reality view, for example, amessage from the retailer highlighting “tax-free”, or a cautionarymessage reading “Floor Wet, Use Caution”. Dynamic renditions may changedynamically as a user walks around in a physical space. One or moredynamic renditions may be further configured to change periodically,repetitively, or a combination thereof. Contextual renditions may beconfigured to follow a user around while the user is shopping. Forexample, a contextual rendition of an augmented reality view may includedirections for emergency exit, or directions to check-out aisles, etc.Other suitable renditions may be displayed.

Hardware device 140 may further comprise processor 180. Processor 180may include one or more known processing devices, such as, but notlimited to, microprocessors from the Pentium™ or Xeon™ familymanufactured by Intel™, the Turion™ family manufactured by AMD™, or anyof various processors from other manufacturers. In some embodiments,processor 180 may execute software instructions or hardware instructionsto perform functions in accordance with the disclosure.

In some embodiments, processor 180 may be configured to receive anaugmented reality view of a physical environment of physical space. Theaugmented reality view may represent one or more physical objects (suchas physical objects 215 in FIG. 2A) in the physical environment. In someembodiments, processor 180 may be configured to employ objectrecognition technology to enable representing a physical object in aphysical environment to an augmented reality view. Object recognitiontechnology in the field of computer generated vision identifies objectsin an image, multiple images, or a video sequence based on a number offactors, including, but not limited to, appearance, features, etc.

Processor 180 may further be configured to present an augmented realityview to a user while the user is present in the physical environment,based on the determined scope of the augmented reality view, via adisplay (such as display 240 in FIG. 2B). Processor 180 may communicatewith other components of hardware device 140. In some embodiments,processor 180 may communicate with database 120 to perform functions inaccordance with the disclosure. Communication between processor 180 andcomponents of hardware device 140, and/or between processor 180 anddatabase 120 may be configured to be executed through network 110.

Processor 180 may execute one or more computer programs configured todetermine further personalization of an augmented reality view of auser. For example, processor 180 may receive authentication informationfrom controller 150 and customize an augmented reality view to a userbased on the authentication information received. The augmented realityview may include physical environment information based on the locationof user overlaid with relevant product details displayed to the user.

Hardware device 140 may include wireless card 190. Wireless card 190 maybe configured to facilitate wireless communication and exchange of databetween hardware device 140 and database 120 through network 110. Insome embodiments, wireless card 190 may be configured to facilitatewireless communication and exchange of data between hardware device 140and database 120 without network 110. In yet other embodiments, wirelesscard 190 may be configured to facilitate wireless communication betweeneach of the components of hardware device 140. Wireless card 190 mayinclude one or more digital and/or analog communication device tocommunicate with and/or detect other components, such as a networkcontroller and/or wireless adapter for communicating over the Internetor suitable Wi-fi communication pathways. Other implementationsconsistent with disclosed embodiments are possible as well.

As shown in FIG. 1, hardware device 140 may include a media recordingunit 195. Media recording unit 195 may be configured to capture image(s)and/or video(s) of an augmented reality view presented to a user via adisplay, image(s) and/or video(s) of a user within a physical space,image(s) and/or video(s) of a physical environment alone. In someembodiments, media recording unit 195 may capture image(s) and/orvideo(s) of any of the combinations thereof. In some embodiments, mediarecording unit 195 may include a local storage device 198 configured tocommunicate with storage unit 160 of hardware device 140. In someembodiments, local storage device 198 of media recording unit 195 may bea stand-alone device.

In some embodiments, images and/or videos captured by media recordingunit 195 may be accessed by other components of hardware device 140associated with presenting an augmented reality view of the physicalenvironment to a user. In some embodiments, images and/or videoscaptured by media recording unit 195 may be stored temporarily instorage device of media recording unit 195 and accessed later forpresenting an augmented reality view of the physical environment to auser. Media recording unit 195 may include other components, such as,but not limited to, a camera, a sound-recording device, a voicerecognition device, and relevant software for supporting executableinstructions to perform functions in accordance with disclosedembodiments.

FIGS. 2A-B illustrate an exemplary system for presenting an augmentedreality view 245 to user 220 with hand-held device 230 in physical space210. Physical space 210 houses one or more physical objects 215.Hand-held device 230 may include display 240 displaying an augmentedreality view 245 including one or more physical objects 215 andmarker(s) 248. Marker 248 may be associated with and/or containinformation related to one or more physical objects 215. Some marker(s)may be an instruction or an indication displayed in augmented realityview 245 for user 220.

Physical space 210 may include a business space, a retail store, awarehouse facility, a departmental store, a grocery store, a shoppingmall, or the like. Physical objects 215 may include a variety ofproducts, such as, but not limited to, furniture items, clothes, fooditems, consumables, sporting goods, medical devices, etc. Physicalobjects 215 may be displayed in physical space 210 in a specific layout.Database 120 may be configured to store information regarding layout ofphysical objects 215 in physical space 210. The layout information mayinclude geographic location information and physical locationinformation describing the position of one object 215 relative to atleast one other object 215 in physical space 210.

As illustrated in FIG. 2A, when user 220 walks into a physical space210, such as a store, hand-held device 230 may map the three-dimensionalspace including the physical environment of physical space 210 havingone or more boundaries such as walls, floors, and ceilings. Images fromone or multiple perspectives, including depth images from hand-helddevice 230 or depth cameras installed in physical space 210, may becombined by an image processing application based on a common coordinatesystem for space. In some embodiments, hardware device 140 may include aGraphics Processing Unit (GPU), not shown in FIG. 1, configured toexecute instructions associated with the image processing application.

Physical objects 215 and/or boundaries of physical space 210 may bedetected, for example, by edge detection techniques. Objects may beidentified by pattern recognition techniques including facialrecognition techniques with reference images of objects and boundariesstored in database 120. In some embodiments, augmented reality view 245displayed on display 240 of hand-held device 230 may display extendedone or more boundaries to allow user 220 to view more products andproduct data than physically displayed. Furthermore, augmented realityview 245 displayed on display 240 of hand-held device 230 includingextended boundaries may be used by the retailer to display more productsand product data.

In some embodiments, the physical environment may extend past currentboundaries to display a larger virtual physical space in augmentedreality view 245. In some embodiments, augmented reality view 245 mayrepresent at least one boundary larger than one of the other boundariesof the associated physical environment to create a larger virtual spaceto display additional products and related information. Extending one ormore boundaries associated with the physical environment may beaccomplished by identifying one or more boundaries and drawing one ormore vectors past the boundary to create a larger virtual space. Othersuitable and well-known techniques may be employed as well.

Hand-held device 230 may be further configured to communicate data suchas the location and the position of user 220, to database 120. Database120 may receive and store information regarding the location andposition of user 220 in real-time, enabling continuous updating of theinformation regarding user 220 location.

FIGS. 2C-D illustrate an exemplary system for presenting an augmentedreality view 260 to user 220 in physical space 210, wearing smarteyewear 250. Physical space 210 houses one or more physical objects 215.Smart eyewear 250 may project an augmented reality view 260 includingone or more physical objects 215. Augmented reality view 260 may beprojected in user's field of view or on a surface such as a screen,wall, etc.

Augmented reality view 260 projected by smart eyewear 250 may allow theretailer more space to show greater depth and more variety of products.Augmented reality view 260 may also allow user 220 with smart eyewear250 to view more products and product data than physically displayed. Insome embodiments, augmented reality view 260 may include image ofphysical space 210 having one or more boundaries. One or more of thewalls, ceilings, and floors may be identified as boundaries. In someembodiments, other physical objects such as, but not limited to, cabinetedges, temporary wall partitioning, doors may be identified asboundaries.

In some embodiments, the physical environment may extend past currentboundaries to display a larger virtual physical space in augmentedreality view 260. In some embodiments, augmented reality view 260 mayrepresent at least one boundary larger than one of the other boundariesof the associated physical environment to create a larger virtual spaceto display additional products and related information. Extending one ormore boundaries associated with the physical environment may beaccomplished by identifying one or more boundaries and drawing one ormore vectors past the boundary to create a larger virtual space. Othersuitable and well-known techniques may be employed as well.

One aspect of the present disclosure is directed to a method ofpresenting an augmented reality view (e.g., 245 or 260) to a user. FIG.3 is a flow chart illustrating an exemplary method of presenting anaugmented reality view to a user, in accordance with disclosedembodiments. In some embodiments, the method for presenting augmentedreality view may be executed by one or more components of system 100.

An exemplary method of presenting an augmented reality view 245 to user220 may include user 220 with a hand-held device 230 walking intophysical space 210, as shown in step 310. Physical space 210 may includea business space, a retail store, a warehouse facility, a departmentalstore, a grocery store, a shopping mall, a business outlet, or the like.In some embodiments physical space 210 may be a museum, a zoo, anaquarium, or the like. In some embodiments, user 220 may represent asingle user or a group of users occupying physical space 210.

In step 320, hand-held device 230 may obtain and/or receive locationinformation of user 220 within physical space 210. The location of user220 may include, for example, geographic information and/or physicallocation of user 220 within physical space 210. The user locationinformation may be stored as coordinates in physical space orlongitudinal and latitudinal coordinate space. Hand-held device 230 mayfurther be configured to obtain and/or receive information related tophysical environment within physical space 210. Information related tophysical environment may include location information of physicalobjects 215 in physical space 210. The location information of physicalobjects 215 may include, for example, geographic information and/orphysical location of physical objects 215 within physical space 210. Thephysical objects 215 location information may be stored as coordinatesin physical space or longitudinal and latitudinal coordinate space.

In some embodiments, physical environment information may include imagesand/or videos of physical objects 215 present in physical space 210.Hand-held device 230 may be configured to obtain the images and/orvideos using an in-built media recording unit 195. Hand-held device 230may further be configured to receive images and/or videos from anexternal media recording unit connected to hand-held device 230, with orwithout network 110. In some embodiments, the external media recordingunit, such as, but not limited to, a camera may be physically connectedto hand-held device 230 through a USB connection.

In step 330, controller 150 of hand-held device 230 may determine thescope of augmented reality view 245 to be presented to user 220.Controller 150 may be configured to determine the scope of augmentedreality view 245 by identifying the relative location and/or orientationof user 220. In some embodiments, controller 150 may be configured todetermine the scope of augmented reality view 245 by identifying therelative location and/or orientation of hand-held device 230.

Controller 150 may be configured to identify the relative locationand/or orientation of user 220 by determining the physical environmentinformation obtained by hand-held device 230. In some embodiments,physical environment information may include location information ofphysical objects 215, one or more boundaries of physical space 210,markers present in physical space 210, or combinations thereof. Otherrelevant physical environment information may be used as well.

In step 340, renderer 170 of hand-held device 230 may render augmentedreality view 245 on display 240 to user 220. Renderer 170 may beconfigured to communicate with controller 150, processor 180, mediarecording unit 195, or other components of hand-held device 230.Renderer 170 may be further configured to render augmented reality view245 in multiple formats including a static rendition, a dynamicrendition, or a contextual rendition, or combinations thereof.

In some embodiments, renderer 170 may render an interactive augmentedreality view 245. User 220 may choose to directly interact withaugmented reality view 245. For example, renderer 170 may render anaugmented reality view of a virtual living room with furniture. User 220may prefer to “move” around furniture placement within the virtualliving room, or replace furniture items with other options available inthe store before making a shopping decision. The interactive augmentedreality view 245 provides user 220 with an enhanced shopping experience.

In some embodiments, renderer 170 renders an augmented reality view 245to allow user 220 to interact with a third-party such as, an expert, ora consultant, or a business owner, or store manager, or a customerrepresentative, or a salesman while shopping. User 220 may be allowed toshare augmented reality view 245 displayed on display 240 of hand-helddevice 230 with the person user 220 is interacting with. In someembodiments, user 220 and the third-party may be allowed to communicate,including sharing text, images, audio, etc. Other interactions betweenuser 220 and the third-party may be allowed as well.

Another aspect of the present disclosure is directed to a method ofpresenting an augmented reality view 245 to user 220. FIG. 4 is a flowchart illustrating an exemplary method of presenting an augmentedreality view 245 to user 220, in accordance with disclosed embodiments.In some embodiments, the method for presenting augmented reality viewmay be executed by one or more components of system 100.

An exemplary method of presenting an augmented reality view 245 to user220 may include user 220 with a hand-held device 230 walking intophysical space 210, as shown in step 410. Physical space 210 may includea business space, a retail store, a warehouse facility, a departmentalstore, a grocery store, a shopping mall, or a business outlet. In someembodiments physical space may be a museum, a zoo, an aquarium, orsimilar display spaces for entertainment purposes. In some embodiments,user 220 may represent a single user or a group of users occupyingphysical space 210.

In step 420, hand-held device 230 may obtain and/or receive locationinformation of user 220 within physical space 210. The location of user220 may include, for example, geographic information and/or physicallocation of user 220 within physical space 210. The user locationinformation may be stored as coordinates in physical space orlongitudinal and latitudinal coordinate space. Hand-held device 230 mayfurther be configured to obtain and/or receive information related tophysical environment within physical space 210. Information related tophysical environment may include location information of physicalobjects 215 in physical space 210. The location information of physicalobjects 215 may include, for example, geographic information and/orphysical location of physical objects 215 within physical space 210. Thephysical objects 215 location information may be stored as coordinatesin physical space or longitudinal and latitudinal coordinate space.

In some embodiments, physical environment information may include imagesand/or videos of physical objects 215 present in physical space 210.Hand-held device 230 may be configured to obtain the images and/orvideos using an in-built media recording unit 195. Hand-held device 230may further be configured to receive images and/or videos from anexternal media recording unit connected to hand-held device 230, with orwithout network 110. In some embodiments, the external media recordingunit, such as, but not limited to, a camera may be physically connectedto hand-held device 230 through a USB connection.

In step 430, controller 150 of hand-held device 230 may determine thescope of augmented reality view 245 to be presented to user 220.Controller 150 may be configured to determine the scope of augmentedreality view 245 by authenticating augmented reality view 245 of user220. Authenticating augmented reality view 245 of user 220 may includeidentification verification of user 220. In some embodiments,identification verification may include exchanging tokens betweenhand-held device 230 and database 120. Exchanged tokens may includesecurity exchange tokens, such as software tokens, as a means touniquely identify user 220 to create a personalized augmented realityview 245. A software token may be a two-factor authentication securitydevice that may be used to confirm identification of the user. Othersuitable identification verification techniques, such as, facialrecognition, retinal scans, iris recognition, finger printing,biometrics, etc. may be used as well.

In some embodiments, controller 150 of hand-held device 230 maydetermine the content of augmented reality view 245 to be presented touser 220. For example, the scope and content of augmented reality view245 may be customized based on authentication results, allowing aretailer to provide a personalized augmented reality view 245 to user220 for an enhanced shopping experience. In some embodiments, onceauthenticated, user profile stored in database 120 may be updated basedon user's 220 shopping experience, such as, date and time of the day,duration at the store, products viewed, products purchased, productsconsidered, etc.

In some embodiments, each of the components of hand-held device 230 suchas, controller 150, storage unit 160, renderer 170, processor 180,wireless card 190, and media recording unit 195 may be configured torequire authentication to perform functions associated with presentingan augmented reality view 245 to user 220.

Upon authentication, controller 150 may determine the rendition formatof physical objects 215 and/or physical environment within physicalspace 210 to user 220, based on the location of user 220 and/or thecontent to be displayed, in step 440. Determining the rendition mayinclude, but not limited to, the format of rendition, layout ofrendition, content of rendition, timing of rendition, etc. For example,controller 150 may determine a rendition format based on the location ofuser 220 or the orientation of user 200.

In some embodiments, controller 150 calculates the way in which physicalobjects 215 and/or physical environment within physical space 210 arerendered to user 220 based on the location of user 220 and/or thecontent to be displayed. Controller 150 may calculate the way in whichobjects and/or physical environment are rendered based on an algorithm,a mathematical expression, a self-learning computer program, etc. Othersuitable methods may be used.

In step 450, controller 150 may communicate the information to berendered to renderer 170 of hand-held device 230. In some embodiments,renderer 170 may include an external rendering device connected withhand-held device 230, through a wired or a wireless connection.

In step 460, renderer 170 may display augmented reality view 245 to user220 on display 240 of hand-held device 230.

Another aspect of the present disclosure is directed to a method ofpresenting an augmented reality view to a user. FIG. 5 is a flow chartillustrating an exemplary method of presenting an augmented reality viewto a user, in accordance with disclosed embodiments. In someembodiments, the method for presenting augmented reality view may beexecuted by one or more components of system 100.

An exemplary method of presenting an augmented reality view 245 to user220 may include user 220 with a hand-held device 230 walking intophysical space 210, as shown in step 510.

In step 520, hand-held device 230 may obtain and/or receive locationinformation of user 220 within physical space 210. The location of user220 may include, for example, geographic information and/or physicallocation of user 220 within physical space 210. The user locationinformation may be stored as coordinates in physical space orlongitudinal and latitudinal coordinate space. Hand-held device 230 mayfurther be configured to obtain and/or receive information related tophysical environment within physical space 210. Information related tophysical environment may include location information of physicalobjects 215 in physical space 210. The location information of physicalobjects 215 may include, for example, geographic information and/orphysical location of physical objects 215 within physical space 210. Thephysical objects 215 location information may be stored as coordinatesin physical space or longitudinal and latitudinal coordinate space.

In some embodiments, physical environment information may include imagesand/or videos of physical objects 215 present in physical space 210.Hand-held device 230 may be configured to obtain the images and/orvideos using a media recording unit 195 that may be built in tohand-held device 230 or connected to hand-held device 230, with orwithout network 110. In some embodiments, the external media recordingunit (e.g., a camera) may be physically connected to hand-held device230 through a USB connection.

In step 530, controller 150 of hand-held device 230 may determine thescope of augmented reality view 245 to be presented to user 220.Controller 150 may be configured to determine the scope of augmentedreality view 245 by authenticating augmented reality view 245 of user220. Authenticating augmented reality view 245 of user 220 may includeidentification verification of user 220. In some embodiments,identification verification may include exchanging tokens betweenhand-held device 230 and database 120. Other suitable identificationverification techniques, such as, facial recognition, retinal scans,iris recognition, finger printing, biometrics, etc. may be used as well.

In some embodiments, controller 150 of hand-held device 230 maydetermine the content of augmented reality view 245 to be presented touser 220. The scope and content of augmented reality view 245 may becustomized based on authentication results, allowing retailer to providea personalized augmented reality view 245 to user 220 for an enhancedshopping experience. In some embodiments, once authenticated, userprofile stored in database 120 may be updated based on user's 220shopping experience, such as, date and time of the day, duration at thestore, products viewed, products purchased, products considered, etc.

In some embodiments, each of the components of hand-held device 230 suchas, controller 150, storage unit 160, renderer 170, processor 180,wireless card 190, and media recording unit 195 may be configured torequire authentication to perform functions associated with presentingan augmented reality view 245 to user 220.

Upon authentication, controller 150 may determine the rendition formatof physical objects 215 and/or physical environment within physicalspace 210 to user 220, based on the location of user 220 and/or thecontent to be displayed. Determining the rendition may include, but notlimited to, the format of rendition, layout of rendition, content ofrendition, timing of rendition, etc. For example, controller 150 maydetermine a rendition format based on the location or the orientationuser 220 is looking at.

In some embodiments, controller 150 calculates the way in which physicalobjects 215 and/or physical environment within physical space 210 arerendered to user 220 based on the location of user 220 and/or thecontent to be displayed. Controller 150 may calculate the way in whichobjects and/or physical environment are rendered based on an algorithm,a mathematical expression, a self-learning computer program, etc. Othersuitable methods may be used. Controller 150 may communicate theinformation to be rendered to renderer 170 of hand-held device 230. Insome embodiments, renderer 170 may include an external rendering deviceconnected with hand-held device 230, through a wired or a wirelessconnection.

In step 540, renderer 170 may display augmented reality view 245 to user220 on display 240 of hand-held device 230. In some embodiments,renderer 170 may display augmented reality view 260 using smart eyewear250.

In step 550, physical environment of physical space 210 and augmentedreality view 245 may be stored in a storage media for instant access ordelayed access. Storage media may include, but not limited to, storage160 of hand-held device 230, local storage device 198 of media recordingunit 195, database 120, database 130, or an external storage mediumincluding a cloud platform, server, computer hard drive etc. The storedinformation may be accessed remotely through an internet connection.

Although aspects of the present invention are described as presentingaugmented reality views to user 220 discusses using hand-held device230, one skilled in the art will appreciate that these aspects can alsobe presented using smart eyewear, head mounted displays, heads updisplays, helmet mounted displays, smart glasses, or other suitablewearable devices. The scope of the invention is defined by the claimsand their equivalents.

The foregoing descriptions have been presented for purposes ofillustration and description. They are not exhaustive and do not limitthe invention to the precise form disclosed. Modifications andvariations are possible in light of the above teachings or may beacquired from practicing of the invention. For example, the describedimplementation includes software but the present invention may beimplemented as a combination of hardware and software or in hardwarealone.

Other embodiments of the invention will be apparent to those skilled inthe art from consideration of the specification and practice of theinvention disclosed herein. The specification and examples should beconsidered as exemplary only, with a true scope and spirit of theinvention being indicated by the following claims.

What is claimed is:
 1. A system for presenting an augmented realityview, comprising: a database server for personalizing an augmentedreality view of a physical environment, the database server comprisingat least one of a location of a physical environment or a location of auser; a hardware device in communication with the database server, thehardware device including: a hardware-implemented renderer configured torender the augmented reality view for display; a hardware-implementedcontroller configured to determine a scope of the augmented reality viewbased on authenticating the augmented reality view; and a processorconfigured to: receive the augmented reality view of the physicalenvironment, the augmented reality view representing one or more objectsin the physical environment, personalize the augmented reality view ofthe physical environment based on the information in the databaseserver; and present, via a display, a personalized augmented realityview to the user while the user is present in the physical environment,based on the determined scope of the augmented reality view, wherein theaugmented reality view represents at least one boundary larger than atleast one boundary of the associated physical environment.
 2. The systemof claim 1, wherein the processor is further configured to execute atleast one computer program configured to determine furtherpersonalization of the augmented reality view.
 3. The system of claim 1,wherein the database server is configured for updating based on anupdated layout of the physical environment.
 4. The system of claim 3,wherein the layout of the physical environment comprises data describingone or more objects in relation to at least one other object.
 5. Thesystem of claim 1, wherein the hardware-implemented renderer is furtherconfigured to add markers for customizing the augmented reality viewbased on at least one of the location of the user or a user preference.6. The system of claim 1, wherein authenticating the augmented realityview comprises identification verification of the user.
 7. The system ofclaim 6, wherein identification verification comprises exchangingsecurity tokens between the hardware device and the database server. 8.The system of claim 1, wherein the processor is further configured to:determine one or more portions of the augmented reality view that arenot authenticated, and present the augmented reality content without thedetermined one or more portions.
 9. The system of claim 1, whereinrendering the augmented reality view comprises rendering one or more ofa static rendition, a dynamic rendition, or a contextual rendition. 10.The system of claim 1, wherein the larger boundary is rendered byvectoring the at least one boundary.
 11. The system of claim 1, whereinthe hardware device further comprises a storage medium configured tostore information related to the augmented reality view of the physicalenvironment.
 12. The system of claim 1, wherein the hardware devicefurther comprises a media recording unit configured to capture at leastone of images or videos of the augmented reality view of the physicalenvironment.
 13. The system of claim 1, wherein the augmented realitycontent presented to the user is determined based on at least one of thelocation or orientation of the hardware device.
 14. A method forpresenting an augmented reality view, the method comprising: receiving,via a processor, the augmented reality view of a physical environment,the augmented reality view representing one or more objects in thephysical environment; determining, via a hardware-implementedcontroller, a scope of the augmented reality view based onauthenticating the augmented reality view; personalizing the augmentedreality view of the physical environment using at least one of alocation of the physical environment or a location of a user; rendering,via a hardware-implemented renderer, the augmented reality view fordisplay; and presenting, via a display, the augmented reality view tothe user while the user is present in the physical environment, based onthe determined scope of the augmented reality view, wherein theaugmented reality view represents at least one boundary larger than atleast one boundary of the associated physical environment.
 15. Themethod of claim 14, wherein authenticating the augmented reality viewcomprises verifying identification of the user.
 16. The method of claim14, further comprising: capturing at least one of images or videos ofthe augmented reality view of the physical environment; and storinginformation related to the augmented reality view of the physicalenvironment.
 17. The method of claim 14, further comprising:determining, via the processor one or more portions of the augmentedreality view that are not authenticated, and presenting the augmentedreality content without the determined one or more portions.
 18. Asystem for presenting an augmented reality view, comprising: a databaseserver for personalizing an augmented reality view of a physicalenvironment, the database server comprising at least one of a locationof a physical environment or a location of a user; ahardware-implemented renderer configured to render the augmented realityview for display; a hardware-implemented controller configured todetermine a scope of the augmented reality view based on identificationverification of the user; and a processor configured to: receive theaugmented reality view of the physical environment, the augmentedreality view representing one or more objects in the physicalenvironment, personalize the augmented reality view of the physicalenvironment based on the information stored in the database server, andpresent, via a display, augmented reality content to the user while theuser is present in the physical environment, based on the determinedscope of the augmented reality view, wherein the augmented reality viewrepresents at least one boundary larger than at least one boundary ofthe associated physical environment.